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IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD 

TECHNICAL FIELD 
5 [0001] The present invention relates to an image 

processing technology in a graphics processor or the like. 
BACKGROUND TECHNOLOGY 

[0002] With the remarkable development of computer 

graphics technology and image processing technology used in 

10 computer gaming, digital broadcast etc, in recent years, more 
detailed display of three-dimensional graphics etc. has 
become possible. In three-dimensional graphics processing, a 
three-dimensional object having three-dimensional coordinate 
data is projected onto a two-dimensional screen for display 

15 on a display or the like. 

[0003] Normally, a three-dimensional object is modeled 

using a combination of polygons (e.g., triangles). In 
projecting a three-dimensional object onto a two-dimensional 
screen, rasterization is performed wherein values like 

20 luminance of pixels inside the polygons are calculated by 
referring to data on vertices of the polygons. 

In rasterization, a linear interpolation method called 
Digital Differential Analyzer (DDA) is used. DDA allows 
obtaining gradient between data for a vertex of a polygon and 

25 data for another vertex of the polygon in the direction of a 
side of the polygon. The gradient thus obtained is used to 
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compute data for the polygon sides. Subsequently, pixels 
inside the polygons are generated by computing the gradient 
in the raster-scan direction. 

[0004] Patent document 1 discloses a technology for 

5 improving rendering speed whereby a pixel group comprising a 
plurality of pixels included in a predefined rectangular area 
is dealt with as a unit of processing and a set of pixel 
groups are transmitted to a processing block in the 
subsequent stage. 

10 [0005] Patent document 2 teaches an improvement over the 

technology described in patent document 1. Processing 
efficiency is improved by merging multiple pixel groups into 
a single pixel group before transmitting the same to a 
processing block in the subsequent stage. 

15 [0006] [patent document 1]JP 2000-338959 A 

[patent document 2]JP 2003-123082 A 
DISCLOSURE OF THE INVENTION 
PROBLEMS TO BE SOLVED BY THE INVENTION 

[0007] With improvements in the performance of image 

20 processing apparatuses for processing three-dimensional 
computer graphics in recent years, the size of a polygon 
forming a three-dimensional object tends to be smaller in 
order to render a more detailed three-dimensional object. 
Consequently, pixel groups including only a limited number of 
25 valid pixels are increasingly more likely to be generated. 

In this background, more efficient merge of rectangular areas 
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(pixel groups) is called for. 

[0008] A general purpose of the present invention in 

this background is to provide an image processing apparatus 
capable of achieving efficient image processing. 
5 MEANS FOR SOLVING THE PROBLEMS 

[0009] An embodiment of the present invention pertains 

to an image processing technology which renders, in a screen 
coordinate system, unit figures each constituting the surface 
of a three-dimensional object to be rendered. In this image 

10 processing technology, a unit figure is divided into multiple 
unit areas on a screen coordinate system so that the unit 
areas are output. Each of the output unit areas is divided 
into multiple subareas. Selected ones of the multiple 
subareas are discarded according to a predetermined rule. 

15 Rendering is performed on subareas that survived the 
discarding process . 
ADVANTAGES OF THE INVENTION 

[0010] According to the image processing technology of 

the present invention, rendering of a unit figure can be 
20 performed efficiently. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0011] Fig. 1 shows the structure of an image processing 

apparatus according to a first embodiment. 

Fig. 2 shows how pixels are generated by a rasterizing 

25 unit. 

Figs. 3A-3C show how multiple stamps are merged under 
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different conditions . 

Fig. 4 shows how a stamp is divided into quads. 

Fig. 5 is a flowchart showing how stamps are merged in 
a merger according to the first embodiment. 
5 Fig. 6 shows how stamps are merged according to the 

flowchart shown in Fig. 5. 

Fig. 7 shows the structure of an area writer. 

Fig. 8 shows how quads are distributed by the area 
writer to output units. 
10 Figs. 9A-9C show how the area writer writes a merged 

stamp into a cache memory. 

Fig. 10 shows another example of merging stamps. 

Fig. 11 shows how the quads are distributed to the 
output units in the area writer. 
15 Figs. 12A-12C show how the area writer writes merged 

stamps shown in Fig. 10 into the cache memory. 

Fig. 13 shows how merge proceeds according to a second 
embodiment when stamps having different stamp addresses are 
input in succession. 
20 Fig. 14 shows how the quads are distributed to the 

output units in the area writer. 

Figs. 15A-15C show how the area writer writes a merged 
stamp of Fig. 13 into the cache memory 50. 
EXPLANATION OF SYMBOLS 
25 [0012] 1000 image processing apparatus, 100 rasterizer, 

200 graphics processor, 300 main processor, 400 main memory, 
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10 rasterizing unit, 20 area divider, 30 area discarder, 40 
area writer, 600 merger, 50 cache memory, 110 memory 
interface unit, 120 graphics memory, 130 display controller 
BEST MODE FOR CARRYING OUT THE INVENTION 
5 [0013] Before giving a specific description of 

embodiments, a summary of the embodiments will be given. 

An embodiment of the present invention relates to an 
image processing apparatus which renders, in a screen 
coordinate system, unit figures each constituting the surface 

10 of a three-dimensional object to be rendered, comprises a 

rasterizing unit which divides a unit figure into a plurality 
of unit areas on the screen coordinate system and outputs the 
unit areas; an area divider which divides each of the unit 
areas output from the rasterizing unit into a plurality of 

15 subareas; an area discarder which discards as necessary a 
subarea obtained by the division by the area divider 
according to a predetermined rule; and an area writer which 
writes a subarea that survived the discarding process by the 
area discarder into a memory. 

20 [0014] According to this embodiment, the number of 

subareas transmitted to a subsequent stage can be reduced for 
efficient rendering, by dividing each of the unit areas into 
the subareas and discarding unnecessary subareas. A unit 
figure is a polygon or a curved surface patch, by way of 

25 examples . 

[0015] The area writer may re-merge subareas that 
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survived the discarding process and writes merged areas 
obtained by re-merge in the memory. 

[0016] Of the subareas that survived the discarding 

process by the area discarder, the area writer may merge 
5 subareas derived from unit areas having the same coordinates 
in the screen coordinate system before the division. 

In this case, it is ensured that the subareas included 
in a merged area obtained as a result of re-merge are all 
derived from the unit areas at the same position. This 
10 eliminates the need to refer to the coordinate of the unit 

area originating each subarea, in writing data related to the 
merged area into the memory. 

[0017] The merged area may have the same size as the 

unit area. In this case, output data from the rasterizing 

15 unit is of the same size as output data from the area writer. 
By ensuring that a unit throughput in the rasterizing unit is 
equal to a unit throughput in writing into the memory, 
hardware and software can be designed flexibly and 
compatibility with existing systems is enhanced. 

20 [0018] The size of the subarea may correspond to a unit 

throughput in which the area writer writes the subareas into 
the memory at a time. 

[0019] The area writer may refer to information 

indicating the relative position of a subarea in the unit 
25 area to which the subarea belonged before the division and 
write the subarea in an address in the memory corresponding 
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[0020] The unit area may be a rectangular area, the 

rasterizing unit may divide a rendering area so that each of 
the plurality of unit areas includes a pixel group, the pixel 
number in the vertical direction and the pixel number in the 
horizontal direction of a pixel group in a given unit area 
being identical with the corresponding numbers of a pixel 
group in another unit area, and the area divider may divide 
the unit area including the pixel group into a plurality of 
subareas each including a small pixel group, the pixel number 
in the vertical direction and the pixel number in the 
horizontal direction of a pixel group in a given unit area 
being identical with the corresponding numbers of a pixel 
group in another unit area. 

[0021] Of the plurality of subareas obtained by the 

division by the area divider, the area discarder may discard 
a subarea that does not include any valid pixels. The term 
"valid pixel" means a pixel which represents an area embraced 
by a unit figure whose luminance value, and/or fog value etc. 
had been generated by the rasterizing unit. 

By discarding subareas that do not include any valid 
pixels, frequency of treating invalid pixels in a processing 
unit in a subsequent stage is reduced so that efficient 
rendering is achieved. 

[0022] Of the subareas that survived the discarding 

process by the area discarder, the area writer may re-merge 
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subareas which do not include valid pixels at identical 
coordinates in the screen coordinate system and may write 
subareas into the memory in units of merged areas obtained by 
re-merge . 

5 By eliminating from re-merge those subareas that have 

valid pixels at identical coordinate in the screen coordinate 
system, loss of information due to overlapping of valid 
pixels is successfully prevented. 

[0023] Of the subareas that survived the discarding 

10 process by the area discarder, the area writer may merge 

subareas derived from unit areas having the same coordinates 

in the screen coordinate system before the division. 

In this case, it is ensured that the subareas included 

in a merged area obtained as a result of re-merge are all 
15 derived from the unit areas at the same position. This 

eliminates the need to refer to the coordinate position of 

the unit area originating each subarea, in writing data 

related to the merged area into the memory. 

[0024] The area writer may refer to information 

20 indicating the relative position of a subarea in the unit 

area to which the subarea belonged before the division so as 

to write the subarea in an address in the memory 

corresponding to the information. 

Even if the information indicating the relative 
25 position of the subarea changes as a result of re-merge, the 

subarea can be written in a proper address by referring to 
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the information indicating the relative position of the 
subarea in the originating unit area. 

[0025] The area writer may comprise a memory access unit 

which writes pixels included in the subarea into the memory 
5 in parallel. 

[0026] Another embodiment of the present invention 

relates to an image processing method. The image processing 
method which renders, in a screen coordinate system, unit 
figures each constituting the surface of a three-dimensional 

10 object to be rendered, comprises: rasterizing by dividing a 
unit figure into a plurality of unit areas on the screen 
coordinate system and outputting the unit areas; dividing 
each of the unit areas output from the rasterizing into a 
plurality of subareas; discarding as necessary a subarea 

15 obtained by dividing the unit area according to a 

predetermined rule; and writing a subarea that survived the 
discarding into a memory. 

[0027] The rasterizing may divide a rendering area so 

that each of the plurality of unit areas includes a pixel 

20 group, the pixel number in the vertical direction and the 

pixel number in the horizontal direction of a pixel group in 
a given unit area being identical with the corresponding 
numbers of a pixel group in another unit area, and the unit 
area dividing may divide the unit area including the pixel 

25 group into a plurality of subareas each including a small 

pixel group, the pixel number in the vertical direction and 
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the pixel number in the horizontal direction of a pixel group 
in a given subarea being identical with the corresponding 
numbers of a pixel group in another subarea. 
[0028] Of the plurality of subareas obtained by the 

5 division, the discarding may discard a subarea that does not 
include any valid pixels. 

[0029] Still another embodiment of the present invention 

relates to a rendering method. The rendering method which 
renders, in a screen coordinate system, unit figures each 

10 constituting the surface of a three-dimensional object to be 
rendered, comprises: dividing a unit figure into a plurality 
of unit areas on the screen coordinate system and outputting 
the unit areas; and generating merged areas by retrieving, 
from a plurality of subareas constituting each of the unit 

15 areas output from the dividing, subareas that include valid 
pixels . 

[0030] Another rendering method which renders, in a 

screen coordinate system, unit figure each constituting the 
surface of a three-dimensional object to be rendered, 

20 comprises: dividing a unit figure into a plurality of unit 

areas on the screen coordinate system and outputting the unit 
areas; and writing subareas, of a plurality of subareas 
constituting each of the unit areas output from the dividing, 
that include valid pixels into a memory in parallel. 

25 [0031] Yet another embodiment of the present invention 

relates to a computer program product. The computer program 
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product which renders, in a screen coordinate system, unit 
figures each constituting the surface of a three-dimensional 
object to be rendered, comprises: a dividing module which 
causes a computer to divide a unit figure into a plurality of 
5 unit areas on the screen coordinate system and outputting the 
unit areas; and a merging module which causes a computer to 
retrieve, from a plurality of subareas constituting each of 
the unit areas output from the dividing, subareas that 
include valid pixels so as to generate merged areas. 

10 [0032] Another computer program product which renders, 

in a screen coordinate system, unit figures each constituting 
the surface of a three-dimensional object to be rendered, 
comprises: a dividing module which causes a computer to 
divide a unit figure into a plurality of unit areas on the 

15 screen coordinate system and outputting the unit areas; and a 
writing module which causes a computer to write subareas, of 
a plurality of subareas constituting each of the unit areas 
output from the dividing, that include valid pixels into a 
memory in parallel. 

20 [0033] Still another embodiment of the present invention 

relates to an image processing apparatus which renders, in a 
screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered. The 
image processing apparatus comprises: a rasterizing unit 

25 which divides a rendering area corresponding to a screen into 
multiple unit areas, while a unit figure is projected onto a 
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screen coordinate system, and subjects a second and 
subsequent unit figures to a similar process so as to 
sequentially output a plurality of unit areas constituting 
each unit figure; an area divider which divides each of the 
5 unit areas sequentially output from the rasterizing unit into 
multiple subareas; an area discarder which discards as 
necessary a subarea obtained by the division by the area 
divider according to a predetermined rule; and an area 
writer which writes a subarea that survived the discarding 

10 process in a memory. 

[0034] Yet another embodiment of the present invention 

relates to an image processing method which renders, in a 
screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered. The 

15 image processing method comprises: rasterizing by dividing a 
rendering area corresponding to a screen into multiple 
congruent unit areas, while a first unit figure is projected 
onto a screen coordinate system, and subjecting a second and 
subsequent unit figures to a similar process so as to 

20 sequentially output a plurality of unit areas constituting 
each unit figure; dividing each of the unit areas 
sequentially output into multiple subareas; discarding as 
necessary a subarea obtained by the dividing the unit area 
according to a predetermined rule; and writing a subarea that 

25 survived the discarding in a memory. 

[0035] Still another embodiment of the present invention 
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relates to a computer program product. The computer program, 
adapted to an image processing apparatus which renders, in a 
screen coordinate system, unit figures each constituting the 
surface of a three-dimensional object to be rendered, 
5 comprises: rasterizing by causing a computer to divide a 

rendering area corresponding to a screen into multiple unit 
areas, while a first unit figure is projected onto a screen 
coordinate system, and to subject a second and subsequent 
unit figures to a similar process so as to sequentially 

10 generate a plurality of unit areas constituting each unit 
figure; and dividing each of the unit areas sequentially 
generated in the rasterizing into multiple subareas; 
discarding as necessary a subarea obtained by the dividing 
according to a predetermined rule; and writing a subarea that 

15 survived the discarding in a memory. 

[0036] Optional combinations of the aforementioned 

constituting elements, and implementations of the invention 
in the form of methods, apparatuses, systems programs may 
also be practiced as additional modes of the present 

20 invention. 

[0037] Several modes of the present invention will be 

described in detail based upon embodiments. 
[0038] (First embodiment) 

Fig. 1 shows the structure of an image processing 
25 apparatus according to a first embodiment. An image 

processing apparatus 1000 performs image processing such as 
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three-dimensional computer graphics processing. The image 
processing apparatus 1000 projects a unit figure (or unit 
graphic form) constituting the surface of an object to be 
rendered onto a rendering area in a screen coordinate system 
5 and generates pixels so as to render the object, which is 
ultimately displayed on a display. 

[0039] The information processing apparatus 1000 

comprises a graphics processor 200, a main processor 300, a 
main memory 400 and a graphics memory 120. The blocks are 

10 connected to each other via a bus 500. 

The information processing apparatus 1000 is connected 
to a display apparatus (not shown) which outputs images and 
graphics generated by the image processing apparatus 1000. 
The elements illustrated in Fig. 1 and subsequent drawings as 

15 functional blocks executing respective processes are 

implemented by hardware including a CPU, a memory and an LSI 
and by software including a program provided with reservation 
and management functions and loaded into the memory. 
Therefore, it will be obvious to those skilled in the art 

20 that the function blocks may be implemented by a variety of 
non-limiting manners including hardware only, software only 
or a combination of both. 

[0040] The main processor 300 performs an operation such 

as three-dimensional computer graphics modeling. The main 
25 memory 400 is a storage area primarily used by the main 
processor 300. For example, modeling data obtained by 
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processing a task related to computer graphics in the main 
processor 300 is temporarily stored in the main memory 400. 
[0041] The graphics memory 120 is a memory area 

dedicated to graphic-related data used and managed by the 
5 graphics processor 200. In addition to a frame buffer and a 
z buffer for storing image frame data, the graphics memory 
120 further comprises areas respectively corresponding to 
vertex data, texture data and a color look-up table, which 
are basic data referred to when rendering image frame data. 

10 [0042] The graphics processor 200 is a block dedicated 

to the execution of an image. The graphics processor 200 
performs a series of steps of rendering in which it reads 
from the main memory 400 three-dimensional modeling data 
generated by the main processor 300 and generates image frame 

15 data by performing coordinate transform, hidden surface 
elimination, shading etc. 

The graphics processor 200 includes a rasterizer 100, a 
memory interface unit 110 and a display controller 130. 
[0043] The rasterizer 100 reads three-dimensional 

20 modeling data from the main memory 400 so as to acquire 

vertex data of a primitive to be rendered. The rasterizer 
100 performs a view transform in which a primitive in a 
three-dimensional space is transformed by projecting the 
primitive onto a screen coordinate system into a figure on a 

25 rendering plane. Further, the rasterizer 100 performs a 
rasterizing process in which the figure on the rendering 
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plane is scanned in the horizontal direction of the rendering 
plane so as to transform, row by row, the figure into 
quantized pixels. The rasterizer 100 decomposes the 
primitive into pixels and computes pixel information for each 
5 pixel. The pixel information includes RGB color values, an a 
value indicating transparency and a Z value indicating depth 
from a view point. 

The rasterizer 100 generates a pixel area of a 
predetermined size along the scan line and outputs the 
10 generated area to the memory interface unit 110. A pixel 

group output from the rasterizer 100 is temporarily stacked 
in a queue. The memory interface unit 110 sequentially 
writes pixel groups stacked in the queue to the graphics 
memory 12 0. 

15 [0044] The memory interface 110 writes pixels in the 

graphics memory 120 or reads a frame buffer from the graphics 
memory 120 in accordance with an instruction from the display 
controller 130. The display controller 130 outputs image 
data read from the graphics memory 120 to the display device. 

20 [0045] A detailed description will now be given of the 

structure and operation of the rasterizer 100. 

The rasterizer 100 includes a rasterizing unit 10, a 
merger 600 and a cache memory 50. 

[0046] The rasterizing unit 10 projects a triangle (a 

25 unit figure constituting the surface of an object rendered) 
onto a rendering area in a screen coordinate system. The 
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rasterizing unit 10 divides the rendering area into multiple 
unit areas, generates pixels included in the unit areas and 
outputs pixel groups for each of the respective unit areas. 
The rasterizing unit 10 sequentially generates pixel groups 
5 for the respective unit areas for output, repeating the step 
of generation for multiple unit figures (triangles) . 
[0047] Fig. 2 shows how pixels are generated by the 

rasterizing unit 10. Fig. 2 shows a part of a rendering area 
2000 in a screen coordinate system. A triangle 12 is a 

10 projection of a triangle (a unit figure constituting the 

surface of a three-dimensional object) onto a rendering area. 
The rasterizing unit 10 generates pixels inside the polygon 
by using the Digital Differential Analyze ( DDA) method, based 
upon the coordinate values, colors, fog values and texture 

15 coordinates of three vertices 12a, 12b and 12c of the 
triangle 12 . 

[0048] The rendering area is divided into multiple 

congruent unit areas 14. 

The rasterizing unit 10 sequentially generates, for 

20 each unit area, pixel information (color, fog value etc.) for 
an area embraced by the triangle 12 and outputs the pixel 
information thus generated for the respective unit areas. 
Hereinafter, pixels for which pixel information is generated 
by the rasterizing unit 10 will be referred to as valid 

25 pixels. 

[0049] In this embodiment, the unit area 14 having a 
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predetermined size includes 4x4 pixels. The 4x4 pixel group 
included in the unit area 14 will be referred to as a stamp 
STP. Each stamp STP maintains position information 
indicating the position of the associated unit area in the 
5 screen coordinate system. Hereinafter, the position 

information of a stamp will be referred to as a stamp address 
ADDstp. 

The rasterizing unit 10 sequentially generates pixel 
information for each of the stamps STP and sequentially 
10 outputs stamps STP that include valid pixels to the merger 
600. 

[0050] The merger 600 merges multiple stamps STP output 

from the rasterizing unit 10 and writes each of the stamps 
thus merged in the cache memory 50 in the subsequent stage. A 

15 stamp obtained by merging the multiple stamps STP in the 

merger 600 will be referred to as a final stamp STPf. The 
rasterizer 100 and the memory interface unit 110 inside the 
graphics processor exchange data with each other, using a 
stamp STP as a unit of processing. 

20 [0051] Merge performed in the merger 600 will be 

described. The merger 600 merges stamps having the identical 
stamp address ADDstp. 

Merge of the stamps is performed using the following 
two parameters. A first parameter represents the size of a 

25 unit referred to for determination as to whether merge is 

possible. A second parameter represents the size of a unit 
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of actual merge. Figs. 3A-3C show how multiple stamps are 
merged under different conditions. A stamp STPm represents a 
merged stamp STPm obtained by merging two stamps STP1 and 
STP2 . 

5 Hereinafter, a small pixel group comprising 2x2 pixels 

obtained by dividing a stamp will be referred to as a quad QD. 
A quad that includes a valid pixel will be referred to as a 
valid quad. 

[0052] Fig. 3A shows merge performed when both two 

10 parameters are "pixels". The stamp STP1 and the stamp STP2 
of Fig. 3A have the identical stamp address. These stamps 
STP do not include valid pixels that occur at identical 
positions. Therefore, upon pixel-by-pixel determination on 
overlapping (occurrence at identical positions) , the stamps 

15 will be merged without any problem. 

[0053] Fig. 3B shows merge performed when both two 

parameters are "quads (QD)". In merge shown in Fig. 3B, a 
determination on occurrence at identical positions is made 
quad by quad. As a result, quads at top right of the stamp 

20 STP1 and the stamp STP2 are both valid and occur at identical 
positions. Therefore, the two stamps are not merged. The 
two stamps STP1 and STP2 are output unmodified. 
[0054] Fig. 3C shows merge according to this embodiment, 

wherein the first parameter is "pixel" and the second 

25 parameter is "quad (QD)". In merge of Fig. 3C, a 

determination on occurrence at identical positions is made 
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pixel by pixel. It is found that quads QD at top right of 
the stamp STP1 and the stamp STP2 are both valid and occur at 
identical positions, but valid pixels are not to found to 
overlap each other upon pixel-by-pixel determination. 
5 Additionally , the total number of valid quads is 4 or fewer. 
Thus, the stamps can be merged into a single stamp STPm. In 
the merged stamp STPm obtained as a result of quad-based 
merge, the position of a quad may be different from the 
original position. This is addressed by relocation described 
10 later. 

As described, in the merge according to this embodiment 
shown in Fig. 3C, determination on occurrence at identical 
positions is made pixel by pixel and merge is performed quad 
by quad. As a result, efficiency in merging the stamp STP1 
15 and the stamp STP2 shown in Fig. 3C is equal to that of Fig. 
3A. When implemented in actual image processing, efficiency 
in merge is most superior in Fig. 3A, followed by Fig. 3C and 
Fig. 3B. 

[0055] Considering the cost required to implement an 

20 image processing apparatus for performing such merge, 

reduction in the size defined by the first parameter, which 
represents a unit referred to for determination of the 
possibility of merge, will only require a change in the unit 
of determination. As such, it does not result in a 
25 considerable increase in implementation cost. In contrast, 

reduction in the size defined by the second parameter, which 
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represents a unit of actual merge, will require increased 
cost for implementing a unit for accessing a memory. Thus, 
in terms of implementation cost, the arrangement of Fig. 3B 
is most favorable, followed by Fig. 3C and Fig. 3A. 
5 [0056] Therefore, the method of merge according to this 

embodiment shown in Fig. 3C is superior in balance between 
efficiency in merge and implementation cost. A description 
will now be given of the structure of the merger 600 for 
achieving the merge according to this embodiment. 

10 [0057] The merger 600 includes an area divider 20, an 

area discarder 30 and an area writer 40. 

The area divider 20 divides stamps STP sequentially 
output from the rasterizing unit 10 into multiple small 
congruent small pixel groups. In this embodiment, the area 

15 divider 20 divides a stamp STP of 4x4 pixels into congruent 

quads QD0-QD3 of 2x2 pixels and outputs the quads to the area 
discarder 30 in the subsequent stage. 

[0058] Fig. 4 shows how the stamp STP is divided into 

the quads QD0-QD3. Each of the quads QD0-QD3 maintains 

20 position information indicating the relative position of the 
quads in the stamp, as a quad address ADDqd. It will be 
assumed that the quad addresses ADDqd are 00, 01, 10 and 11, 
starting with the top left quad and ending with the bottom 
right quad. In Fig. 4, the quad addresses are parenthesized. 

25 The area divider 20 outputs multiple pixels in units of 

quads QD to the area discarder 30 in the subsequent stage. 
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[0059] The area discarder 30 retains selected quads QD 

selected from the multiple quads QD output from the area 
divider 20 and discards the rest. The area discarder 30 
outputs the quads QD that survived the discarding process to 
5 the area writer 40 in the subsequent stage. 

[0060] The area writer 40 writes the quads QD that 

survived the discarding process by the area discarder 30 to 
the cache memory 50. In this process, the quads that 
survived the discarding process by the area discarder 30 are 
10 re-merged and are used to reconstruct a stamp comprising 4x4 
pixels. A stamp re-merged by the area writer 40 will be 
referred to as a merged stamp STPm. 

[0061] The area writer 40 writes the merged stamp STPm 

output from the area discarder 30 in the cache memory 50 as a 

15 unit of processing. The merged stamp STPm written in the 

cache memory 50 is stacked in a queue. The memory interface 
110 sequentially writes the merged stamp STPm thus stacked 
into the graphics memory 120. Since the merged stamp STPm is 
not necessarily identical with the final stamp STPf, the area 

20 writer 40 relocates quads within the merged stamp STPm as 
described later. 

[0062] A detailed description of processes in the area 

divider 20, the area discarder 30 and the aera writer 40 will 
now be given. 

25 Of those stamps STP sequentially output from the 

rasterizing unit 10, stamps that are targets of division by 
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the area divider 20 will be referred to as source stamps STPs. 
A stamp which is obtained by sequentially and temporarily 
dividing source stamps STPs into quads, discarding 
unnecessary quads QD and re-merging stamps will be referred 
5 to as a merged stamp STPm. A stamp used in the process of 
merging source stamps STPs and maintained to be subject to 
merge will be referred to as a target stamp STPt. 

The merger 600 merges by sequentially writing quads QDs 
of the source stamps STPs into empty quads of the target 
10 stamp STPt. 

[0063] Fig. 5 is a flowchart showing how stamps STP are 

merged in the merger 600 according to this embodiment. 
[0064] Prior to starting a merge process, the area 

writer 40 initializes a target stamp STPt (S100) . 

15 The area writer 40 then initializes a variable j to 0 

(S102) . The variable j indicates the place, in the sequence 
of quads in the target stamp STPt, up to which the quad is 
valid. For example, if j=0, it indicates that no valid quad 
is written in the target stamp STPt. If j=4, it indicates 

20 that the target stamp STPt is filled with quads. 

[0065] The area divider 20 then acquires a source stamp 

STPs (S104) . Acquiring of a source stamp STPs is achieved by 
reading a stamp STP output from the rasterizing unit 10. 
[0066] The stamp address ADDstp of the target stamp STPt 

25 and that of the source stamp STPs are then compared (S106) . 

If the addresses of the two stamps differ (N in S106) , merge 
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is not performed and the current target stamp STPt is output 
to the area writer 40 in the subsequent stage as a merged 
stamp STPm (S130) . The target stamp STPt is then initialized 
(S132) . In association with the initialization of the target 
5 stamp STPt, the variable j is set to 0 (S134). Control is 
then returned to S108. 

[0067] If the addresses of the two stamps are identical 

(Y in S106) , the area divider 20 divides the source stamp 
STPs into four quads QDsO-QDs3 (S108) . 

10 A variable i is then initialized to 0 (S110) . The 

variable i indicates where, in the sequence of quads in the 
source stamp STPs subject to merge, the quad being processed 
is positioned. For example, if i=0, the quad QDsO of the 
source stamp STPs is being processed. 

15 [0068] The area discarder 30 then determines whether the 

ith quad QDsi of the source stamp STPs includes any valid 
pixel (S112) . If the quad QDsi does not include any valid 
pixel (N in S112), the quad QDsi is discarded (S160). The 
variable i is incremented by 1 to proceed to the next quad 

20 QDsi (S126) . 

[0069] If the quad QDsi includes a valid pixel (Y in 

S112), the area writer 40 determines whether any of the valid 
pixels in the quad QDsi occurs at the identical position as a 
valid pixel of the target stamp STPt (S114). The 

25 determination is made by determining whether the quad QDsi 
and the target stamp STPt include valid pixels at the same 
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coordinate position in the screen coordinate system. 
[0070] If there are- valid pixels occurring at identical 

positions (Y in S114), merge is not performed and the current 
target stamp STPt is output as a merge stamp STPm. The 
target stamp STPt is initialized and the variable j is 
returned to 0 (S140-S144). Control then proceeds to the 
merge process described below (S116-S128) . 

If there are no valid pixels occurring at identical 
positions (N in S114), control also proceeds to the merge 
process described below (S116-S128) . 

[0071] The quad QDsi of the source stamp STPs is written 

in the jth quad QDtj of the target stamp STPt (S116) . The 
variable j is then incremented by 1 in order to shift the 
position of writing in the target stamp STPt (S118) . 

If j=4, it means that the quads QDs of the source 
stamps are merged with all quads QDtO-QDt3 of the target 
stamp STPt. Therefore, the current target stamp STPt is 
output as a merged stamp STPm (S150) . The target stamp STPt 
is then initialized (S152) and the variable j is set to 0 
(S154) . The variable i is incremented by 1 to proceed to the 
next quad QDsi (S126) . 

[0072] If j^4, it means that there is an empty quad in 

the target stamp STPt. The target stamp STPt is maintained 
as it is and the variable i is incremented by 1 to proceed to 
the next quad QDsi (S126) . 

[0073] A determination on the variable i is made. If 
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i=4 (Y in S128), it means that merge is completed for all 
quads QDsi belonging to the source stamp STPs. Thereupon, 
the next source stamp STPs is acquired (S104) . 

[0074] If i^4, control is returned to S112 to proceed to 

5 the next quad QDsi. 

[0075] As described, the merger 600 merges if the stamp 

addresses of the target stamp STPt and that of the source 
stamp STPm are identical and if there are no valid pixels 
occurring at identical pixel positions. 

10 [0076] Fig. 6 shows how stamps are merged according to 

the flowchart shown in Fig. 5. We consider a case where the 
stamps STP1-STP4 are sequentially input to the area divider 
20. It will be assumed that the target stamp STPt is empty. 
The stamp STP1 will be the source stamp STPs and is 

15 divided by the area divider 20 into the four quads QDs0-QDs3. 
Since the quads QDsl-QDs3 do not include any valid pixel, 
they are discarded by the area discarder 30. 

Only the quad QDsO that survived the discarding process 
by the area discarder 30 is output to the area writer 40 and 

20 is written in the quad QDtO of the target stamp STPt. 

[0077] Subsequently, the stamp STP2 will be the source 

stamp STPs and is divided by the area divider 20 into the 
four quads QDsO-QDs3. The area discarder 30 discards the 
quads QDsl-QDs3. The area writer 40 writes the quad QDsO in 

25 the quad QDtl of the target stamp STPt. 

A similar process is performed for the stamps STP2 and 
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STP3. Quads QDO having the quad address ADDqd of (00) and 
derived from the stamps STP1-STP4 are written in the quads 
QDtO-QDt3 of the target stamp STPt so as to generate a merged 
stamp STPm. 

5 [0078] The quads QDmO-QDm3 included in the merged stamp 

STPm maintain their quad addresses in the originating stamps 
STP1-STP4 as position information. The merged stamp STPm is 
output to the area writer 40 along with the position 
information. 

10 [0079] Fig. 7 shows the structure of the area writer 40. 

The area writer 40 includes a memory access unit 44 and 
a distributor 42. The memory access unit 44 is provided with 
output units 4 6a-4 6d for simultaneously writing four pixels 
included in a quad into the cache memory 50 in parallel. 

15 The distributor 42 distributes pixels constituting a 

quad QD to the output units 46a-46d. The top left pixel in a 
quad is distributed to the output unit 46a, the top right 
pixel to the output unit 46b, the bottom left pixel to the 
output unit 4 6c, and the bottom right pixel to the output 

20 unit 46d. 

By repeating the operation of simultaneously writing 
the four pixels into the cache memory 50 in parallel four 
times in units of quads, the area writer 40 completes a 
process of writing into one merged stamp. 
25 [0080] Fig. 8 shows how the quads QDmO-QDm3 are 

distributed by the area writer 40 to the output units 46a-46d. 
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The distributor 42 divides the merged stamp STPm into the 
four quads QDmO-QDm3 and sequentially distributes them to the 
output units 46a-46d at times Tl, T2, T3 and T4 . 

At time Tl, the distributor 42 decomposes the quad QDmO 
5 into pixels and distributes the pixels to the four output 
units 46a-46d. Each output unit writes the pixel derived 
from decomposition into the cache memory 50. Subsequently, 
the quads QDml-QDm3 are decomposed into pixels at times T2, 
T3 and T4 and are sequentially output. An output of a merged 
10 stamp STPm is produced in each unit period comprising times 
T1-T4. 

[0081] Figs. 9A-9C show how the area writer 40 writes 

the merged stamp STPm into the cache memory 50. Fig. 9A 
shows the cache memory 50; Fig. 9B shows how writing of quads 

15 by the area writer 40 proceeds; and Fig. 9C shows the final 
stamp STPf obtained upon completion of the writing. 
[0082] Since the merged stamp STPm is not necessarily 

identical with the final stamp STPf, the area writer 40 
relocates quads within the merged stamp STPm. 

20 The relocation is done as described below. 

At time Tl, the area writer 40 writes pixels included 
in the quad QDmO of the merged stamp STPm into the cache 
memory 50. The area writer 40 refers to the quad address 
ADDqd of the quad QDmO. Since the quad address ADDqd of the 

25 quad QDmO is 00, the quad QDmO is written in an address 00 of 
the cache memory 50. 
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Subsequently, the quad QDml is written at time T2 . 
Since the quad address of the quad QDml is also 00, the quad 
QDml is also written in the address 00 of the cache memory 50. 
Similarly, the quads QDm2 and QDm3 are written in the address 
5 00 at times T3 and T4, respectively. 

[0083] As a result of all quads QDmO-QDm3 being written 

in the quad address ADDqd=00 , the final stamp STPf in which 
the stamps STP1-STP4 of Fig. 6 are merged is generated. 
[0084] Fig. 10 shows how other stamps STP5-STP8 are 

10 merged. These stamps have identical stamp address and there 
are no valid pixels occurring at identical positions. 
[0085] First, the stamp STP5 is divided into four quads 

QDsO-QDs3. Since only the quad QDsO includes a valid pixel, 
the quad QDsO is written in the quad QDtO of the target stamp 

15 STPt. The quads QDsl-QDs3 are discarded. 

Subsequently, the stamp STP6 will be the source stamp 
STPs so that the quads QDsO-QDs3 are subject to merge. As a 
result, the quads QDsO and QDs2 are written in the quads QDtl 
and QDt2 of the target stamp STpt, and the quads QDsl and 

20 QDs3 are discarded. 

[0086] Subsequently, the stamp STP7 will be the next 

source stamp STPs. The quad QDsO of the stamp STP7 is 
written in the quad QDt3 of the target stamp STpt. In this 
state, all quads in the target stamp STPt are valid so that 

25 the target stamp STPt is output as a merged stamp STPml . The 
target stamp STPt is then initialized. 
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[0087] Subsequently, the quad QDs2 of the source stamp 

STPs is written in the quad QDtO of a new target stamp STPt. 
The quads QDsl and QDs3 are discarded. 

[0088] The stamp STP8 will be the next source stamp. 

5 Since the quads QDsO-QDs3 all include valid pixels, the quads 
are written in the target stamp STPt without being discarded. 

The quads QDsO-QDs2 are written in the quads QDtl-QDt3 
of the target stamp STPt. In this state, all quads in the 
target stamp STPt are valid so that the target stamp STPt is 
10 output as a merged stamp STPm2. The target stamp STPt is 
initialized again . 

[0089] The quad QDs3 of the source stamp STPs is written 

in the quad QDtO of the new target stamp STPt. The quad QDtO 
is then merged with quads from other source stamps STPs. The 

15 resultant target stamp is output as a merged stamp STPm3 . 
[0090] Fig. 11 shows how the quads QDmO-QDm3 are 

distributed to the output units 46a-46d in the area writer 40. 

The area writer 4 0 outputs the four quads QDmO-QDm3 
within the merged stamp STPml in the stated order at times Tl, 

20 T2, T3 and T4, respectively. 

The distributor 42 of the area writer 40 distributes 
the four pixels included in each quad to the respective 
output units. The merged stamp STPml is written in a period 
comprising times T1-T4; the merged stamp STPm2 is written in 

25 a period comprising times T5-T8; and the merged stamp STPm3 
is written in a period comprising times T9-T12. 
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The quads QDmO-QDm3 constituting each of the merged 
stamps STPml-STPm3 are output along with their addresses in 
the originating stamps STP5-STP7 . 

[0091] Figs. 12A-12C show how the area writer 40 writes 

the merged stamps STPml-STPm3 shown in Fig. 10 into the cache 
memory 50. At scheduled times, the area writer 40 refers to 
the addresses of the quads and writes the quads into the 
cache memory 50, relocating them. 

As a result, as shown in Fig. 12C, the final stamp STPf 
in which the stamps STP5-STP8 are merged is written in the 
cache memory 50. The memory interface unit 110 in the 
subsequent stage writes the final stamp STPf in the graphics 
memory 12 0. 

[0092] Thus, according to the image processing apparatus 

1000 of this embodiment, stamps, which are pixel groups 
representing units of processing output from the rasterizing 
unit 10, are divided into quads, which are smaller pixel 
groups. Unnecessary quads are discarded and quads that 
survived are merged. This can increase the number of valid 
pixels including in merged stamps obtained as a result of 
merge, resulting in an efficient rendering process. 
[0093] It will be particularly noted that the nature of 

a triangle strip is likely to generate a series of stamps 
which have an identical stamp address and in which valid 
pixels do not occur at identical positions. Accordingly, by 
merging a series of stamps efficiently, the number of valid 

SC05086WO00 (SC-70145WO) 



32 

pixels can be increased. 

The image processing apparatus according to this 
embodiment temporarily divides the stamps into quads for 
pixel-based determination as to whether merge is possible, 
5 while the actual process of merge is quad-based. Accordingly, 
a favorable balance is achieved between implementation cost 
and processing efficiency. 

[0094] Further, the merged stamp STPm produced by the 

area discarder 30 is corrected by the area writer 40 into a 

10 final stamp STPf, which is ultimately output, through 

localized, intra-stamp relocation. Relocation performed by 
the area writer 40 is implemented by control of addresses in 
the cache memory 50 and relocation using cross bars. 
Addition or modification in hardware is required only in the 

15 memory access unit. The inventive approach can easily be 
implemented in conventional image processing apparatuses. 
[0095] (Second embodiment) 

The second embodiment represents an improvement in 
which the stamp merge process described with reference to the 

20 first embodiment is expanded. In the first embodiment, quads 
are subject to merge only when the source stamp STPs has an 
identical stamp address as the target stamp STPm. The 
characteristic feature of the second embodiment is that merge 
of stamps having different stamp addresses is permitted. 

25 Hereinafter, merge wherein merge of stamps having different 
stamp addresses is permitted will be referred to as an 
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expanded merge. 

[0096] Fig. 13 shows how merge proceeds when stamps 

having different stamp addresses are input in succession. 
Stamps STP10-STP13 are sequentially input from the 
5 rasterizing unit 10 to the area divider 20. It will be 

assumed that the stamp address ADDstp of the stamps STP10 and 
STP11 is 0001 and the stamp address ADDstp of the stamps 
STP12 and STP13 is 0010. None of the valid pixels in the 
stamps STP10-STP13 occurs at identical positions. 
10 [0097] The area divider 20 uses the stamp STP10 as the 

source stamp STPs and divides the stamp STP10 into quads 
QDsO-QDs3. The quad QDsO is written in the quad QDtO of the 
target stamp STPt, and the quads QDsl-QDs3 are discarded. 

Subsequently, the stamp STP11 will be the source stamp 
15 STPs and is divided into the quads QDsO-QDs3. The quad QDsO 
is written in the quad QDtl of the target stamp STPt. 

Subsequently, the stamp STP12 will be the source stamp 
and is divided into the quads QDsO-QDs3. The quad QDs2 is 
written in the quad QDt2 of the target stamp STPt. 
20 Subsequently, the stamp STP13 will be the source stamp 

and is divided into the quads QDsO-QDs3. The quad QDs2 is 
written in the quad QDt3 of the target stamp STPt. 

The quads not written in the target stamp STPt are all 
discarded. 

25 [0098] In this state, all quads in the target stamp STPt 

are valid so that the target stamp STPt is output as a merged 
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stamp STPm, and the target stamp is initialized. 
[0099] Quads QDmO-QDm3 included in the merged stamp STPm 

maintain their quad addresses ADDqd in the originating stamps 
STP10-STP13 along with the stamp addresses ADDstp of the 
5 originating stamps STP10-STP13. 

Fig. 14 shows how the quads QDmO-QDm3 are distributed 
to the output units 46a-46d in the area writer 40. The 
memory access unit 44 of the area discarder 30 outputs the 
four quads QDmO-QDm3 within the merged stamp STPm in the 

10 stated order at times Tl, T2, T3 and T4, respectively. At 
time Tl, the quad QDmO is decomposed into pixels, which are 
simultaneously output in parallel. 

Subsequently, the quads QDml-QDm3 are decomposed into 
pixels and are sequentially output at times T2, T3 and T4, 

15 respectively. 

[0100] Figs. 15A-15C show how the area writer 40 writes 

the merged stamp STPm of Fig. 13 into the cache memory 50. 

As shown in Fig. 15A, the area writer 40 refers to the 
stamp address ADDstp in addition to the quad address ADDqd, 

20 in writing the quads QDm. For example, the quad QDmO input 
at time Tl has a stamp address of 0001 and a quad address of 
00, the quad QDmO is written in an associated address in the 
cache memory 50. A similar thing is true of the quads QDml- 
QDm3. 

25 As a result, as shown in Fig. 12C, the final stamps 

STPfl and STPf2 in which the stamps STP10-STP13 of Fig. 10 
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are merged are written into the cache memory 50. The final 
stamp STPfl is a result of merging the stamps STP10 and STP11. 
The final stamp STPf2 is a result of merging the stamps STP12 
and STP13. The final stamps STPfl and STPf2 are written in 
5 positions with the stamp addresses ADDstp of 0001 and 0010. 
[0101] By performing expanded merge according to the 

embodiment in which stamps having different addresses are 
temporarily merged, the number of times that the area writer 
40 accesses the cache memory 50 can be reduced. 

1° According to expanded merge, merge can be performed 

even if stamp addresses differ. Therefore, the number of 
valid quads within a merged stamp can be increased and 
efficiency in image processing can be improved. 
[0102] The embodiment described is only illustrative in 

15 nature and various variations in constituting elements and 
processes involved are possible. Those skilled in the art 
would readily appreciate that such variations are also within 
the scope of the present invention. 

[0103] In the described embodiments, a stamp comprising 

20 4x4 pixels forms a pixel group, and a quad comprising 2x2 

pixels forms a small pixel group. Other configurations are 
also possible. For example, an array of 1x4 pixels may form 
a small pixel group, or an array of 4x1 pixels may form a 
quad. 

25 The number of pixels included in a quad is preferably, 
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but not necessarily, equal to the number of pixels 
simultaneously written in the cache memory 50 in parallel. 
The number of pixels included in a quad may be two, in a 
configuration in which four pixels are simultaneously written 
5 in the cache memory 50 in parallel. The size of a stamp and 
the size of a quad may appropriately be determined by 
considering the hardware cost and the cost required in 
implementing the process. 
INDUSTRIAL USABILITY 
10 [0104] The present invention can be applied to an image 

processing technology in a graphics processor or the like. 
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